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2005 Overview 

Stennis Space Center 

• OBJECTIVE: Provide independent verification of IRS 
geopositional accuracy claims and of the internal 
geopositional characterization provided by Lutes (2005) 1 

• Assessed six sub-scenes (Quads): three from each AWiFS 
camera 

• Manually matched check points to digital orthophoto quarter 
quadrangle (DOQQ) reference (assumed accuracy ~5 m, 
RMSE) 

• Check points were selected to meet or exceed Federal 
Geographic Data Committee’s guidelines 2 

• Used ESRI ArcGIS® for data collection and SSC-written 
MATLAB® scripts for data analysis 

1 Lutes, J., 2005. Resourcesat-1 geometric accuracy assessment. In proceedings of The ASPRS 2005 Annual Conference, Baltimore, MD, March 7-11. Available at 

http://www.spaceimaqinq.com/whitepapers pdfs/2005/Lutes ASPRS2005 ResourceSat Accuracy Assessment.pdf . 

2 Federal Geographic Data Committee, 1998. Geospatial Positioning Accuracy Standards - Part 3: National Standard for Spatial Data Accuracy. FGDC-STD-007.3-1998. Subcommittee for 

Base Cartographic Data. 28 p. http://www.fqdc.gov/standards/proiects/FGDC-standards-proiects/accuracv/part3/chapter3 . 
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Characterized Scenes 


Stennis Space Center 



Distribution of Scenes 
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Acquisition 

Camera 

270-36-C 
14 AUG 2004 

AWiFS-A 

277-42-C 
5 MAR 2005 

AWiFS-A 

282-50-C 
17 JAN 2005 

AWiFS-A 

270-36-D 
14 AUG 2004 

AWiFS-B 

276-47-D 
24 MAR 2005 

AWiFS-B 

278-47-D 
27 APR 2005 

AWiFS-B 
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Methods 
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Check Point Error 


Stennis Space Center 



• Check Point Error - differences 
between image and reference 
coordinates 


AX =X -X , 

i image, i reference, i 


A Y =Y. .-Y , 

i image, i reference, i 


• Check point error radial 
magnitude calculated by 

AR t = A /AX,. 2 +A^ 2 
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Sources of Error 


Stennis Space Center 



Assessment Error 

- Ground Control Error 

• Pointing 

• Measurement 

- Analyst Error 

• Pointing 

Product Error (potential) 

- Spatial Resolution 

- Pointing (Displacement) 

- Azimuth 

- Scale 

- Orthogonality 

- Other product distortion 

- Terrain effects 


■\ 


r ^ 

“Pointing error” for surveyors & analysts indicates the 
errors these individuals have in picking their target 


> random error 


“Measurement error” for ground control indicates the 
error inherent in the measuring instrument or system 
(in this case, the GPS) 


V constant systematic error 
< ' 


“Pointing error” for a geoimaging system indicates 
the constant separation between estimated target 
coordinates and actual target coordinates 

y functional systematic error 


J 
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Error Model: Primary Components 

Stennis Space Center 


The error model chosen for generalized assessment 

^ image ^ ^ Where £ ^constant ^ zero-mean 

Horizontal Bias - an estimate of the constant error, designated here as 
IJ H , is the magnitude of the vector sum of the average error in the X and 
the Y 




\ax) +(ay] 


• Circular Standard Error - an estimate of the zero-mean circular 

equivalent error valid even for elliptical error distributions with minimum 
to maximum error ratios as low as 0.6 


~ G AX + °~A Y 
2 


where 


^ AX ~ 



Xi^-Arf 

i n - 1 

n — 1 


Ager (2004) 1 used the horizontal error defined on the right, but Greenwalt and Shultz 
(1962) 2 found this to be invalid for minimum to maximum error ratios less than 0.8 


°H = 


'XX 


+ (7 


AY 


1 Ager, T.P., 2004. An Analysis of Metric Accuracy Definitions and Methods of Computation. NIMA InnoVision white paper. 

2 Greenwalt, C.R., and M.E. Shultz, 1962. Principles of Error Theory and Cartographic Applications. ACIC Technical Report No. 96, United States Air Force, Aeronautical Chart and 

Information Center, St. Louis, Missouri, 98 pp. 
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Error Model: Zero-Mean Component s 

^ Stennis Space Center 


• The zero-mean error model 

o — 8 \U]~\~ 8 

° zero-mean ° along -track \ l / 


across -track 


8 


non -systematic 


Where w is the across-track position 


It is important to examine the zero-mean error more closely in the case 
of AWiFS because the error distribution clearly departs from a simple 
circular error distribution with a horizontal bias 

The along and across track errors, while functionally more complex than 
horizontal bias, are still systematic errors that are largely correctable 

The non-systematic error represents random error and harder to model 
errors such as terrain distortion; this error is the most difficult (costliest) 
to correct 
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Defining Area of Analysis 


Stennis Space Center 



• Area of analysis 
defined as the 
“parallelogram”* 
with the largest 
area useful for 
analysis rather 
than the nominal 
AWiFS quad 
boundaries 

* East and west bounds are 
not perfectly parallel. 
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Methods: Selecting & Distributing 

^ Stennis Space Center 

Check Points 

• Area of analysis 
divided into 
quadrants and 
check points 
selected in each 

- Selected 45 to 50 
points (NSSDA 
minimum = 20) 

- At least 20% in 
each quadrant 

- Did not strictly 
maintain point 
separation of 10% 
of diagonal 
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Data Collection Notes 


Stennis Space Center 


• Tentative check points were collected in ESRI ArcMap using 
heads-up digitizing to a point shapefile overlaying the 
AWiFS source image 

• All check point data were collected in the AWiFS scene- 
specific Lambert Conformal Conic projection 

• Reference images (typically DOQQs) were identified and 
added to the ArcMap project; on-the-fly re-projections by 
ArcMap were found to be sufficient 

• Reference images were searched for tentative check points 
identified in the AWiFS source image 

- If a tentative point was missing or indistinct in the reference 
image, both images were searched for an alternative 

- No more than one check point was used per reference image 
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Example AWiFS Check Point 

Stennis Space Center 

DOQQ AWiFS 


r 


V 


Obtained DOQQ 
containing point 
(DOQQ RMSE 
assumed ~5 m) 



AWiFS 




X 


' Extracted A WiFS ^ 
image coordinate 
and DOQQ 

reference 

^ coordinate j 
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Check Point Collection Flow 

Stennis Space Center 


AWiFS 

Source 

Image 



Delineate 

Usable 

Area 


For each tentative point ... 


Break Into 
Quadrants 


Identify 


Search 

DOQQ 

— ► 

for Point 

Reference 


in Reference 


Select a New Tentative Source 
Point Near But Outside Failed 
Reference 


Select 
Tentative Source 
Points 

i 



Yes 


Add Point 
To Source & 
Reference 
Analysis Sets 

Yes 



Analysis 

Source 

Points 



Analysis 
Reference 
Points 
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Check Point Blunder Detection 


Stennis Space Center 



• Transform the frame of reference for the check points from the AWiFS image 
projection to a quasi-satellite-path frame (approximate along track position: 
positive Y, approximate across track position: positive X) 

- Shift frame origin to minimum X, minimum Y of analysis area 

- Rotate frame so that satellite-path direction (approximated by average 
azimuth of east and west bounds of analysis area) is up 

• Compute residuals from difference in source and reference coordinates of check 
points 

• Compute zero-mean residuals by subtracting overall means from residuals 

• Plot both components of zero-mean residuals vs. across track check point 
positions 

- Along track zero-mean residuals vs. across track position 

- Across track zero-mean residuals vs. across track position 

• Observe the plots to determine if systematic relationship between position and 
error exists 

• If systematic relationship exists, determine if some of the check points depart 
from a clear trend (this is a subjective choice in the 2005 analysis) 

• Re-submit any out-of-step points to be re-evaluated as check points 

• Repeat check point blunder detection 
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Stennis Space Center 



Before Blunder Detection 


Pseudo-Along- Track Error vs Pseudo-Across-Track Position 
AW1FS 270-36- D, 14 AUG 2004 
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Pseudo-Across-Track Error vs. Pseudo-Across-Track Position 
AWiFS 270-36-D, 14 AUG 2004 
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After Blunder Detection 


Stennis Space Center 



PseudoAlong- Track Error vs Pseudo-Across-Track Position 
AW1FS 270^36- D f 14 AUG 2004 


80 r 


60 


40 


& 20 

LU 


3 
6 

■o -20 ■ 


(29 

Cl 7 


04 

Cl 8 


<54 

<31 


■0)8... CD1 

m 


(19 

as 


06 


20 03 


-40 


-60 


07 

06 


-80 L 


_i L_ 


28 

04 


C1Q 

as ai 


_J 1_ 


_l L_ 


0.5 


1.5 2 2.5 

Pseudo-Across-Track Position (m) 


3.5 


x 10' 


Pseudo-Across-Track Error vs. Pseudo-Across-Track Position 
AWiFS 270-36- D, 14 AUG 2004 
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Ana l yses Flow 


Stennis Space Center 



/ Analysis 
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Stennis Space Center 



Results 
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Individual Scene Results 


Stennis Space Center 



AWiFS A(1) 


Stennis Geometric Assessment Vector Plot 
AWiFS 270-36-C, 14 AUG 2004 
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Individual Scene Results 


Stennis Space Center 
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AWiFS A (2) 
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Individual Scene Results 


Stennis Space Center 
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Individual Scene Results 


Stennis Space Center 



AWiFSB(l) 


Stennis Geometric Assessment Vector Plot 
AWiFS 270-36-D, 14 AUG 2004 
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Individual Scene Results 


AWiFS B (2) 
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Individual Scene Results 


Stennis Space Center 



AWiFS B (3) 


Stennis Geometric Assessment Vector Plot 
AWiFS 278-47-D, 27 APR 2005 
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Overall Scatter 


Stennis Space Center 


AWiFS Scatterplot 
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Some general characteristics: 

Error distributions showed 
much greater spread in the 
across-scan direction (large 
departure from circularity) 

CEg 0 ranged from 410 m to 
1890 m 
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Stennis Space Center 



Zero-Mean ^Errors by Samp le 


AWiFS-A 
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There was little correlation between 
sample position and error in the along- 
scan direction 


270-36-C, 14 Aug 04 
282-50-C, 17 Jan 05 
277-42-C, 5 Mar 05 


Across-scan errors for AWiFS-A have a 2nd order relationship with sample position 


AWiFS-B 
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Standard products appear to be 
correctable with simple polynomial 

rectification 


Across-scan errors for AWiFS-B have a linear relationship with sample position 
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Summary of Results 


Stennis Space Center 



AWiFS Product 

Acquisition 

Date 

Sub-scene 

Horizontal 
Bias (m) 

Circular Std. 
Error (m) 

Empirical 
CEgo (m) 

AWiFS-A Geo 

14-Aug-2004 

270-36-C 

354 

41 

423 

17- Jan-2005 

282-50-C 

636 

74 

823 

5-Mar-2005 

277-42-C 

475 

54 

599 

AWiFS-B Geo 

14-Aug-2004 

270-36-D 

262 

92 

438 

24-Mar-2005 

276-47-D 

274 

110 

413 

27-Apr-2005 

278-47-D 

1826 

89 

1887 


• The mean CE go of AWiFS Geo images characterized was 760 m 

- Ranged from 423 m to 1 887 m 

• Lutes (2005) analyzed 8 AWiFS scenes and found a mean CE 90 of 610 m 

- Ranged from 294 m to 756 m 

• Both analyses are in general agreement with the exception of the 27 APR 2005 results in the SSC study 

• Both analyses show generally grosser error than the estimate of 320 m stated in the IRS-P6 Data 
User’s Manual (2003) 1 


1 National Remote Sensing Agency, 2003. IRS-P6 Data User’s Manual. Edition No. 1. IRS-P6/NRSA/NDC/HB-10/03, Department of Space, Govt, of India. October, 142 p. 
http://www.euromap.de/download/P6 data user handbook.pdf (accessed February 6, 2006). 
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